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@ Method and system for delaying the activation of inacth^ity security mechnanisms in a multimedia 
data processing system. 

(57) A data processing systenn has a security 
mechanism to lock up a secured input device, 
such as a keyboard, after the secured input 
device has been inactive or unused after a 
predetenmined event, such as the expiration of 
a period of time, has occurred. Multimedia input 
devices are used to provide alternatives to the 
secured input device. Activation of the security 
mechanism is delayed when using an alternate 
or multimedia input device by providing an 
emulating input to the security mechanism. The 
emulating input simulates an input produced by 
the secured input device. The emulating input is 
produced before the predetenmined event oc- 
curs if the alternate input device has produced 
an input. Furthenmore, some altemate input 
devices, such as voice recognition systems, 
have general input properties and provide 
non-user inputs, such as background noise. 
Therefore, user inputs are distinguished from 
non-user inputs so that non-user inputs do not 
delay activation of the security mechanism. 
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The present invention relates to security mecha- 
nisms that prevent a user from accessing a data pro- 
cessing system through a particular user interface 
due to inactivity on the user Interface. 

In a data processing system, user interfaces pro- 5 
vide the way that users access the data processing 
system. A user Interface typically Includes, among 
other things, a keyboard and a display. 

User interfaces are commonly fitted with security 
mechanisms to prevent unauthorized entry into the 10 
data processing system. This is particularly true in of- 
fice environments where many people can easily ac- 
cess a user Interface. One type of security mecha- 
nism locks or disables the keyboard after the key- 
board has been Inactive for a specified period of time. 15 
The security mechanism assumes that If the user has 
not engaged in any keyboard activity for some time, 
for example, fifteen minutes, then the user may have 
gotten up and walked away from the keyboard. So, af- 
ter fifteen minutes has passed, the keyboard is 20 
locked to prevent any unauthorized entries or inputs 
by passersby at the unattended keyboard. With some 
type of systems, the display even goes blank to pre- 
vent sensitive information from being displayed to cu- 
rious eyes. Once the keyboard locks, the user can un- 25 
lock it by entering his password. This allows reentry 
Into the data processing system through that particu- 
lar user interface. 

A problem with the prior art security mechanisms 
is that in multimedia systems the keyboard can be by- 30 
passed as an input device. The keyboard Is a clumsy 
input device. One goal in making computers more 
"user friendly"" is to eliminate the keyboard entirely as 
an input device. Therefore, voice recognition systems 
and touch screen systems are being employed as al- 35 
ternative Input devices to keyboards. Voice recogni- 
tion systems allow application programs to be control- 
led entirely by voice commands, while touch screen 
systems allow a user to touch icons on display 
screens to input commands. 40 

Use of these non-keyboard input devices in 
conjunction with prior art security mechanisms cau- 
ses problems because the security mechanisms do 
not recognize inputs from the non-keyboard devices. 
With a voice recognition system, for example, the 45 
user can be speaking to the user interface when sud- 
denly the user interface is locked up by the keyboard 
security mechanism. Lockup occurs because the 
keyboard security mechanism does not recognize in- 
put from the voice recognition system. When lockup 50 
occurs, no further voice commands are accepted and 
the display goes blank. To prevent lockup when using 
the voice recognition system, the user must either re- 
member to use the keyboard periodically, or more ty- 
pically, endure the periodic lockups and reenter the 55 
data processing system when necessary. Either way, 
the user's concentration is interrupted, resulting in 
frustration and inefficiencies. 



Another problem caused by the use of non-key- 
board input devices in conjunction with prior art secu- 
rity mechanisms is the difficulty of distinguishing 
between a user input and a non-user input. Due to its 
general input properties, a voice recognition system 
will pick up background noise. This background noise 
might be accidently interpreted as a user input by the 
security mechanism. Such an interpretation thwarts 
the function of the security mechanism. 

It is an object of the present invention to provide 
a method and system for Integrating multimedia Input 
devices into inactivity security mechanisms for a data 
processing system user interface. 

It is anotherobject of the present invention to pro- 
vide a method and system for distinguishing between 
a user input and a non-user Input for the purpose of 
integrating multimedia input devices into inactivity se- 
curity mechanisms for a data processing system user 
interface. 

The present invention is used in a data proces- 
sing system having a user interface. The user inter- 
face has respective first and second input means for 
providing respective first and second inputs to the 
data processing system. The data processing system 
has means for securing the user interface such that 
after a predetermined event has occurred without the 
first input from the first input means occurring, the se- 
curing means secures the first input means to prevent 
further information from being input by the first input 
means. The present invention delays the securing 
means from securing the first input means. The pre- 
sent invention determines If, in the absence of the 
first input from the first input means, the second input 
means provides the second input before the oc- 
currence of the predetermined event. An emulating 
input is provided if the second input means has pro- 
vided the second input before the occurrence of the 
predetermined event. The emulating input simulates 
the first input from the first input means. 

The present invention allows an alternate input 
device (such as a voice recognition device) to be used 
with a secured input device (such as a keyboard) ha- 
ving a security mechanism that recognizes inputs 
from the secured input device. The present invention 
causes an input from the alternate input device to 
emulate an input from the secured input device so 
that the security mechanism is deceived into accep- 
ting an input from the alternate Input device. The se- 
curity mechanism thus delays locking up the user in- 
terface. 

Because of the general input properties of some 
Input devices, such as voice recognition systems, 
non-user types of inputs (such as background noise) 
can be generated. The present invention determines 
if the input is a user input or a non-user input. If the 
input is of the non-user type, then it is ignored. If the 
input is user provided, then it is used to delay the ac- 
tivation of the security mechanism. 
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Fig. 1 is a block diagram showing the data pro- 
cessing system of the present invention, in accordan- 
ce with a preferred embodiment. 

Fig. 2 is a component flow diagram of the present 
invention. 

Figs. 3-5 are flow charts showing the method of 
the present invention, in accordance with a preferred 
embodiment Fig. 3 shows the registration process for 
registering input devices. Fig. 4 shows the monitor 
process t hat determines if an input is a user Input from 
a registered input device. Fig. 5 shows the activator 
process for emulating an input from a keyboard in or- 
der to prevent the activation of the security mecha- 
nism. 

Fig. 6 illustrates the elements in an attribute state. 

In Fig. 1, there is shown a data processing sys- 
tem 11 of the present invention. The system 11 has a 
central processor 13 which has memory located the- 
rein. A user interface is connected to the processor 
13. The user interface Includes an output device in 
the form of a display 15 and input devices in the form 
of a mouse 17, a keyboard 19, a voice input device 21 
and a pen tablet 23. All of the input and output devices 
are connected to the processor 1 3. A memory device 
in the form of a hard disk storage device 25 is connec- 
ted to the processor. An input media device 27 is also 
connected to the processor 13. The input media de- 
vice 27 receives a disk 29 or other type of computer 
readable medium. The disk 29 has computer program 
logic recorded thereon, which logic Implements the 
present invention. There is also provided a printer 31 
connected with the processor 13. 

In Fig. 2, there is shown a component flow dia- 
gram of the various hardware and software compo- 
nents of the present invention. The software compo- 
nents reside In the data processing system. All of the 
Input devices 17. 19, 21, 23 are connected so as to 
send their respective interrupts to an Interrupt routine 
41 . The interrupt routine 41 is associated with one of 
the input devices, typically the keyboard 19. The out- 
put of the interrupt routine 41 communicates with a 
security mechanism 43 through a co-resident inter- 
cept handler 45. The security mechanism 43 is a pro- 
gram that Is executed on the data processing system 
1 1 . The co-resident Intercept handler 45 is co-resident 
in memory with the security mechanism 43. The se- 
curity mechanism 43 typically looks for interrupts 
from the secured input device (such as the keyboard 
1 9). If a secured Input device Interrupt is not received 
within a predetermined period of time, the security 
mechanism locks the secured input devices and the 
other input devices. In addition, the co-resident inter- 
cept handler 45 communicates with whatever applica- 
tion program 44 or programs are being executed. A ti- 
mer service 47 bidirectionally communicates with the 
co-resident intercept handler 45. A threshold monitor 
49 also bidirectionally communicates with the co-re- 
sident intercept handler 45. The timer service 47 is 
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the dock of the data processing system 11. The 
threshold monitor 49 is used to distinguish a user in- 
put from the non-user input Two user interfaces are 
provided. A registration interface 51 communicates 
5 with the co-resident intercept handler 45. An ena- 
ble/disable interface 53 bidirectionally communicates 
with the co-resident intercept handler 45. The inter- 
face 53 is used to enable and disable the co-resident 
interrupt service. 

10 The method of the present invention will now be 

described with reference to the flowcharts of Figs. 3- 
5. In the flow charts, the following graphical conven- 
tions are observed: a diamond for a test or decision 
and a rectangle for a process or function. These 

15 conventions are well understood by those skilled in 
the art, and the flow charts are sufficient to enable 
one skilled in the art to write code in any suitable 
computer programming language, such as BASIC, 
PASCAL or C for a computer such as the IBM Perso- 

20 nal System/2 (PS/2) family of computers which sup- 
ports these languages. 

When the user installs at his user interface an al- 
ternate input device that is not a device that the se- 
curity mechanism 43 is sensitive to, he must register 

25 that alternate input device. Registration allows input 
interrupts from the device to be identified as such, 
thus providing for the continued disabling of the se- 
curity mechanism. Registration occurs through the 
registration interface 51. 

30 The registration process is shown in Fig. 3. The 

registration process Is started and initialized, step 61, 
when a user seeks to register an input device. In the 
first step 63. the process gets the interrupt of the se- 
cured input device. In the discussion that follows, the 

35 keyboard 19 will be used as an example of the secu- 
red input device and the voice input device 21 will be 
used as an example of the alternate input device. This 
step identifies which channel the keyboard Interrupt 
is operating on. The next step 65 gets the interrupt of 

40 the voice input device 21 which is being registered. In 
steps 67 and 69. the two interrupts are checked for 
validity and accuracy. In step 67, a valid interrupt ta- 
ble is accessed. In step 69. the determination is made 
if interrupts are valid by comparing the interrupts 

45 against the valid interrupt table. If NO. the interrupts 
are not valid, the method proceeds to step 71. where 
the error is reported to the user. Then, the determi- 
nation is made if the registration process is exited, 
step 73. If NO. then the method loops back to step 63 

50 to try again. If YES. then the method stops, step 75. 

If the result of step 69 is YES. the interrupts are 
valid, then the method gets the threshold value, step 
77. Typically, this is user supplied. The threshold va- 
lue is used to decide if an input on the voice input de- 

55 vice 21 is a user input or a non-user input (such as 
background noise on a voice recognition device). One 
way to express the threshold value is by a confidence 
factor. For example, the audio input of the voice input 

3 
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device 21 would be compared to recognizable, stored 
samples of valid user inputs. The confidence factor is 
a percentage, indicating the percent confidence that 
an input is a user input. Different input devices can 
have different threshold values. 5 

The next step 79 involves getting an emulation 
key or code from the application program 44. The 
emulation key is a "safe" key on the keyboard 1 9 that 
has no effect on the application program. For exam- 
ple, an emulation key might be the '"ALT"" key. This io 
emulation key Is assigned to the particular input de- 
vice being registered. Next, the method gets the de- 
layed time, step 80. The delayed time determines 
when the method will delay the security mechanism 
by providing an Input that is acceptable to the security is 
mechanism. It is only necessary to delay the security 
mechanism when the time limit on the security me- 
chanism is about to expire. However, the user can se- 
lect a shorter delayed time to ensure that the security 
mechanism will be delayed. The threshold value, the 20 
emulation key and the delayed time are loaded into a 
monitor table, step 81. The registration process then 
stops, step 75. 

When an input device produces an interrupt input 
to input data into the application program 44 (see Fig. 25 
2), that interrupt input is intercepted by the co-resi- 
dent intercept handler 45. The co-resident Intercept 
handler 45 has a piece of memory referred to as an 
attribute state 83 (see Fig. 6). The attribute state 83 
has three elements therein, namely an interrupt input 30 
85 from an input device, a data input 87 produced by 
the input device and the time 89 that the input event 
occurred. 

The monitor process of Fig. 4 processes interrupt 
inputs of input devices to determine if they are valid 35 
user interrupts. The monitor process begins when an 
input device interrupt is received. Alternatively, the 
monitor process can be used to periodically poll for in- 
terrupts. The monitor process determines if a secu- 
red input device (such as the keyboard 19) or an al- 40 
ternate input device (such as the voice input 21) has 
produced the interrupt input. If the secured input de- 
vice produced the interrupt input, then the 6vent of 
the occurrence of the interrupt input is written to the 
attribute state 83. If the alternate input device produ- 45 
ced the interrupt input, the data input is evaluated to 
determine if a user produced the data input. If the 
data input is user produced, then the event of the oc- 
currence of the interrupt and data Inputs is written to 
the attribute state. so 

After the monitor process Is started and initiali- 
zed, step 91. the monitor table is accessed, step 93. 
Then the method determines if the interrupt is from 
the keyboard 19, which is the secured input device, 
step 95. If YES. then the method proceeds to step 97 55 
where the event is written to the attribute state (see 
Fig. 6). This involves writing the keyboard interrupt in- 
put, the data input and the event time to the attribute 



state 83. Then, the method stops, step 99. 

If the result of step 95 is NO, then the method 
proceeds to step 101 to determine If the interrupt in- 
put is from the voice input device 21, which is the al- 
ternate input device. If YES, then the method pro- 
ceeds to step 103 to determine if the threshold is met. 
The threshold monitor 49 determines if the data input 
is a valid user input, by comparing the data Input to 
the threshold value. If the result of step 103 is YES, 
the threshold is met, then the next step is step 97 
where the voice input device interrupt input, data in- 
put and event time are written to the attribute state 83. 

If the result of either step 101 or 103 is NO, then 
the method goes in to a wait mode, step 105. The 
method enters the wait mode either when an in- 
terrupt input is not from a registered input device or 
when a data input has not been qualified as a user in- 
put. In the wait mode, the method waits for an in- 
terrupt input. When an Interrupt input is detected, 
either by receipt or by polling, then step 95 is repea- 
ted. 

Referring now to Fig. 5, the activator process will 
be described. The activator process reads the attribu- 
te state 83 to determine if the activation of the secu- 
rity mechanism 93 should be delayed. If the attribute 
state 83 contains an event, then the activator process 
produces an emulating input that is acceptable to the 
security mechanism, wherein the lockup of the input 
devices is avoided. This emulating input emulates an 
input from the keyboard. 

The activator process is started and initialized, 
step 111. Then, the process synchronizes itself with 
the clock on the data processing system, step 113. 
This synchronizes the activator process with the se- 
curity mechanism 43 so that the activator process 
can accurately predict the length of the expiration 
time. The synchronization step 113 can occur through 
user calibration. For example, the user could press 
ENTER on the keyboard, wherein an interrupt would 
be produced to restart the predetermined period of 
time used by the security mechanism. Next, the 
method determines if it Is time to read the attribute 
state, step 115. The co-resident intercept handler 45 
acquires this time to read information from the timer 
service 47. The time to read is determined by the de- 
layed time registered by the user in step 80, Fig. 3. If 
the result of step 115 is NO, then the method loops 
back to step 115. If YES, then the method proceeds 
to step 117 where the attribute state 83 is read. Next, 
in step 1 1 9. the method determines from the attribute 
state 83. if there is activity on the keyboard 19, Fig. 
2, or secured input device, channel. If YES. the key- 
board 19 has produced an interrupt input, then the 
method loops back to step 115, because the key- 
board itself has delayed the activation of the security 
mechanism. If NO. the keyboard has not produced an 
interrupt input, then the method proceeds to step 
121, where it determines, from the attribute state 83. 
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if the voice input device 21 has been activated. \f the 
result of step 121 is NO, then the method loops back 
to step 115 for a re-reading of the attribute state 83 to 
check if any registered input device has been activa- 
ted or used since the last reading. If YES, then the 5 
method proceeds to step 123, where an emulation in- 
put is produced and sent to the security mechanism 
43. The emulation input, which uses the emulation 
key, emulates an input from the secured input device, 
and thus prevents the security mechanism from io 
locking the input devices 17. 19, 21, 23. Then, the 
method loops back to step 1 15 to again await reading 
the attribute state. 

An advantage of the present invention is that it 
can be retrofitted into existing security mechanism is 
systems. The co-resident intercept handler 45 of Fig. 
2 is interposed between the interrupt routine 41 and 
the security mechanism 43, so as to intercept inputs 
before they reach the security mechanism. By inter- 
cepting the inputs of the alternate devices, the co-re- 20 
sident intercept handler can produce an emulating in- 
put. 

Although the present invention has been descri- 
bed in conjunction with the occurrence of a particular 
predetermined event, namely the expiration of a pe- 25 
nod of time during which a particular input device has 
been inactive, the present Invention can be used in 
conjunction with other types of predetermined 
events. For example, an external event (external to 
the data processing system) can be used as criteria 30 
for activating the security mechanism. An example of 
such an external event includes when a user's tele- 
phone is not a swered. Without the present invention, 
failure to answer the user's telephone would result in 
the security mechanism being activated. However, 35 
with the present invention, input from an alternate de- 
vice would delay the activation of the security mecha- 
nism even if the user's telephone was not answered. 
In addition, an event, whether internal or external, 
could be defined as inactivity for the purpose of acti- 40 
vating the security mechanism, or activity for the pur- 
pose of delaying the activation of the security mecha- 
nism. An example of an event that could be defined 
either as inactivity or activity would be the use of sha- 
red memory. 45 

The predetermined event could be defined over 
the entire data processing system, or It could be de- 
fined for a single user interface. 

Although the present invention has been descri- 
bed with external input devices, internal processes 50 
and applications could be used as well. Applications 
which emulate external devices can benefit from the 
present invention. 

The foregoing disclosure and the showings made 
in the drawings are merely illustrative of the principles 55 
of this invention and are not to be interpreted in a li- 
miting sense. 



Revendications 

1. In a data processing system having a user inter- 
face, said user interface having respective first 
and second input means for providing respective 
first and second inputs into said data processing 
system, said data processing system having 
means for securing said user interface such that 
after a predetermined event has occurred 
without said first input from said first input means 
occurring, said securing means securing said 
first input means to prevent further information 
from being input by said first input means, the inrv 
provement comprising a method for delaying said 
securing means from securing said first input 
means, said method comprising the steps of: 

a) determining if, in the absence of said first 
input from said first input means, said second 
input means provides said second input befo- 
re the occurrence of said predetermined 
event; and 

b) providing an emulating input to said secu- 
ring means if said second input means has 
provided said second input before the oc- 
currence of said predetermined event, said 
emulating input emulating said first input from 
said first input means. 

2. The method of claim 1 wherein said second input 
from said second input means comprises a user 
input and a non-user input, further comprising 
the steps of: 

a) determining if said second input is said user 
input; and 

b) providing said emulating input if said se- 
cond input is said user input. 

3. The method of claim 2 wherein said step of deter- 
mining if said second input is said user input 
comprises the step of comparing of said second 
input to a predetermined user input. 

4. The method of claim 1 wherein said step of deter- 
mining if said second input is provided by said se- 
cond input means comprises the step of monito- 
ring interrupts from said second input means. 

5. The method of daim 1 further comprising the 
step of selecting said emulating input such that 
said emulating input has a null effect on an appli- 
cation process receiving said first and second in- 
puts. 

6. The method of claim 1 wherein said predetermi- 
ned event comprises an expiration of a predeter- 
mined period of time, further comprising the 
steps of: 

a) determining when said predetermined pe- 
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riod of time is to expire; and 
b) providing said emulating Input if said se- 
cond Input means has provided said second 
input before said predetermined period of time 
has expired. 5 

7, A data processing system having a user interfa- 
ce, said user interface having respective first and 
second input means for providing respective first 
and second inputs to said data processing sys- io 
tem, said data processing system having means 
for securing said user interface such that after a 
predetermined event has occurred without said 
first input from said first input means occurring, 
said securing means securing said first input is 
means to prevent further information from being 
input by said first input means, said data proces- 
sing system delaying said securing means from 
securing said first input means, said data proces- 
sing system comprising; 20 

a) means for determining if. in the absence of 
said first input from said input means, said se- 
cond input means provides said second input 
before the occurrence of said predetermined 
event; and 25 

b) means for providing an emulating input to 
said securing means if said second Input 
means has provided said second input before 
the occurrence of said predetermined event, 

said emulating input emulating said first input 30 
from said first input means. 

8. The data processing system of claim 7 further 
comprising means for selecting said emulating In- 
put such that said emulating Input has a null ef- 35 
feet on an application process receiving said first 
and second inputs. 
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